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Calculating a Level of Detail (LOD) During Computer 
5 Graphics Processing 

by Inventors 
Walt Donovan 

1 0 John Montrym 

FIELD OF THE INVENTION 

1 5 The present invention relates to computer graphics, and more particularly to 

determining the level of detail (LOD) for texture mapping during computer graphics 
processing. 

Background of the Invention 

20 

Recent advances in computer performance have enabled graphic systems to 
provide more realistic graphical images using personal computers and home video 
game computers. In such graphic systems, some procedure must be implemented to 
"render" or draw graphic primitives to the screen of the system. A "graphic 
25 primitive" is a basic component of a graphic picture, such as a polygon, e.g., a 
triangle, or a vector. All graphic pictures are formed with combinations of these 
graphic primitives. Many procedures may be utilized to perform graphic primitive 
rendering. 
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Early graphic systems displayed images representing objects having 
extremely smooth surfaces. That is, textures, bumps, scratches, or other surface 
features were not modeled. In order to improve the quality of the image, texture 
mapping was developed to model the complexity of real world surface images. In 
general, texture mapping is the mapping of an image or a function onto a surface in 
three dimensions. Texture mapping is a relatively efficient technique for creating 
the appearance of a complex image without the tedium and the high computational 
cost of rendering the actual three dimensional detail that might be found on a surface 
of an object. 



Many parameters have been texture mapped in conventional systems. Some 
of these parameters include surface color, specular reflection, normal vector 
perturbation, specularity, transparency, diffuse reflections, and shadows. In texture 
mapping, a source image known as the "texture" is mapped onto a surface in three 
15 dimensional space. The three dimensional surface is then mapped to the destination 
image. The destination image is then displayed on a graphic display screen. 
Examples of the texture of an object include the gravel on a highway or scuff marks 
on a wooden surface. 



20 One tool used during texture mapping is an environment map. An 

environment map is an image or collection of images which characterize the 
appearance of a scene when viewed from a particular position. Each type of 
environment map has an associated projection which is used to compute the 
appearance along a ray traveling in a particular direction towards the camera. Not all 

25 types of environment maps capture the scene in every direction. 



A variety of different forms of environment maps have been used in the past. 
An orthographic projection of a reflecting sphere to characterize the illumination of a 
scene is described by Williams in "Pyramidal Parametrics", Computer Graphics, 
30 Vol. 17, No. 3, pgs. 1-11, July, 1983. The intention was to use the environment map 
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as an aid to the rapid computation of specular reflections. In an article by Greene 
entitled "Environment Mapping and Order Applications of Worlds Projections", 
IEEE Computer Graphics and Applications, Vol. 6, No. 11, pgs. 21-49, November, 
1986, six images on the faces of a cube are used for a "cubic environment map". 

Due to some limitations, spherical environment mapping is challenging to do 
in real time, and produces artifacts. If the reflection vector is used as an index into a 
cubic environment map, one can avoid these artifacts since sphere map 
approximations can also be generated from a six-sided (or cube) environment map 
by using texture mapping to project the six cube faces onto a sphere. The six cube 
faces capture the environment color for all 3-D reflection directions without 
singularities. 

During use of a cubic environment map, software Tenderers calculate a 
reflection vector for each pixel, and use this to index into an axis-aligned cube map, 
a latitude/longitude map, or a sin(latitude)/longitude map. The cubic environment 
map is a general table controlling what is reflected by the surface. Because the map 
is indexed by the reflection vector, specular spread functions can be incorporated 
into the maps themselves if they are based solely on the relative reflection angle, 
thus allowing highlighting, i.e. Phong highlighting. 

Cubic environment mapping has proved effective because the eye gets a clear 
impression of surface curvature from the reflection's distortion of the environment 
image. Cubic environment maps express source illumination by direction alone. It is 
built upon texture mapping, which is becoming more common and comparable in 
performance to linear shading. For more information on the basics of environment 
mapping, reference may be made to Blinn, Jim and Newell, Martin. "Texture and 
Reflection in Computer Generated Images". Communications of the ACM, Vol. 19, 
No. 10 (1976), pp. 542-547. 
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Occasionally, when rendering an object using a cubic environment map, one 
texel, or texture element, will correspond directly to a single pixel that is displayed 
on a monitor. In this situation the level of detail (LOD) is defined to be equal to zero 
(0) and the texel is neither magnified nor minified. However, the displayed image 
5 can be a magnified or minified representation of the object. If the object is 
magnified, multiple pixels will represent a single texel. A magnified object 
corresponds to a negative LOD value. If the object is minified, a single pixel 
represents multiple texels. A minified object corresponds to a positive LOD value. 
In general, the LOD value roughly corresponds to the amount of the cubic 
10 environment map "covered" by a single pixel. The common convention is that each 

*fi LOD is exactly half the size of the next higher-detail LOD, but LODs do not need to 

iff 

yi be restricted that way. Given that common convention, we then define the LOD 

m number as the log 2 of the texel to pixel scale ratio. Thus, LOD 0 means the pixel to 

is:; 

texel scale is 1 to 1 . 

r 15 

JT] The amount of detail stored in different LOD representations may be 

s « appreciated by drawing an analogy to the detail perceived by an observer while 

Q observing an object. For example, very little detail may be perceived by an observer 

™" while watching an automobile from a distance. On the other hand, several details 

20 such as doors, windows, mirrors will be perceived if the observer is sufficiently 

close to the automobile. A finer level LOD may include such additional details also. 

For example, in Prior Art Figure 1, the top ball 100 is shown with a LOD that is 2 

levels coarser than the bottom ball 102. 

25 During texture mapping, conventional texture coordinates, i.e. s, t, r and q, 

are received and output coordinates, i.e. u, v, and p are outputted. From such 
outputted values, the LOD is calculated. One prior art method of calculating the 
LOD is set forth in Equation #1 . 

30 Equation #1 
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LOD = log 2 LOD\ where 

LOD' = max (u, 2 + v x 2 + p x 2 ) 1/2 , (u/ + 11/ + p y 2 ) m 

= [a(u*q)/ox - u*d(q)/dx]/q 
v x = [5(v*q)/dx - v*a(q)/ox]/q 
Px " [5(p*q)/&t - p*a(q)/ax]/q 

Uy = [5(u*q)/ay - u*a(q)/ay]/q 
v y = [<5(v*q)/ay - v*a(q)/ay]/q 
P y = [«CP*q)/5y - p*a(q)/ay]/q 

As shown in Equation #1, differentiation is required to calculate the LOD. 
Such calculation is extremely time consuming, and may not be suitable for certain 
hardware. It is desirable to provide fast and simple circuits and methods for 
determining the LOD so that texture mapping can be performed fast in real time. 

There is therefore a need for a system that allows for more efficient LOD 
calculation during the texture mapping process. 
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Disclosure of the Invention 



A system, method and article of manufacture are provided for calculating a 
level of detail (LOD) value for use during computer graphics processing. First, a 
5 plurality of geometrically arranged coordinates is identified. A distance value is 
computed based on the geometrically arranged coordinates. A LOD value is then 
calculated using the distance value for use during computer graphics processing. In 
one embodiment, a derivative value is estimated based on the geometrically arranged 
coordinates, and the distance value is computed based on the derivative value. Such 
10 numerical solution provides a more efficient LOD calculation as opposed to 
alternative analytical methods. 



In one embodiment of the present invention, the geometrically arranged 
coordinates include (z 0 , z l9 z 2 , z 3 ) which may take the form of texture coordinates (Uo, 



™] 15 u u u 2 , u 3 ), texture coordinates (v 0 , v l9 v 2 , v 3 ), or texture coordinates (p 0 , p„ p 2 , p 3 ). 
iu The geometrically arranged coordinates (z 0 , z„ z 2 , z 3 ) may also be representative of a 

O quadrilateral with z 0 being an upper left comer of the quadrilateral, z x being an upper 

*™ right comer of the quadrilateral, z 2 being a lower left comer of the quadrilateral, and 

z 3 being a lower right corner of the quadrilateral. As an option, the quadrilateral may 
20 be a 2x2 pixel quadrilateral. 

In another embodiment of the present invention, the derivative value is a 
derivative with respect to an x-axis. In such embodiment, the derivative value is 
calculated using the expression ((z l . z 0 ) + (z 3 . z 2 ))/2. In an alternative embodiment, 
25 the derivative value is a derivative with respect to an y-axis. In such embodiment, 
the derivative value is calculated using the expression ((z 2 .z 0 ) + (z 3 .z 1 ))/2. 

In yet another embodiment of the present invention, the geometrically 
arranged coordinates are transformed into a different coordinate system (l,m,n). The 
30 distance value is then estimated using an expression selected from the group of (1, - 
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1 0 ) 2 + ( mi - mo) 2 + (n, - no) 2 , (1 2 - 1 0 ) 2 + (m 2 - i^) 2 + (n 2 - rio) 2 , (1 3 - l,) 2 + (m 3 - m,) 2 + 
(n 3 - n,) 2 , and (1 3 - 1 2 ) 2 + (m 3 - m 2 ) 2 + (n 3 - n 2 ) 2 . 

In one aspect of the present invention, the LOD value is calculated during 
general texture mapping, programmable pixel shading, or during the use of 
dependent textures. In an alternative aspect, the LOD value may be calculated for 
cube environment mapping, or for any other purpose. 

In the case where the geometrically arranged coordinates (z 0 , z„ z 2 , z 3 ) reside 
on separate sides of a cube map during cube environment mapping, measures may be 
carried out to prevent erroneous results. In particular, a coordinate space transform 
may be performed. 

In yet another aspect of the present invention, it may be determined if the 
signs of the q-values of the pixels in the 2x2 quadrilateral are the same. If it is 
determined that the signs of the q-values of these pixels are not the same, the 
coordinate values are based in different half spaces and thus cannot be used to 
compute a correct LOD. As such, the LOD value may be set to infinity. 

These and other advantages of the present invention will become apparent 
upon reading the following detailed description and studying the various figures of 
the drawings. 
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Brief Description of the Drawings 

The foregoing and other aspects and advantages are better understood from 
the following detailed description of a preferred embodiment of the invention with 
reference to the drawings, in which: 

Figure 1 illustrates a pair of graphical images having different level of detail 
(LOD) values; 

Figure 2 illustrates a flowchart delineating the steps of calculating a level of 
detail (LOD) during the cube environment mapping process in accordance with one 
embodiment of the present invention; 

Figure 2 A is a diagram illustrating the geometrically arrangement of texture 
coordinates which in accordance with one embodiment of the present invention; 

Figure 3 is a flow diagram illustrating the detailed steps associated with 
calculating the LOD using planar computations in operation 216 of Figure 2 in 
accordance with one embodiment of the present invention; 

Figure 4 is a flow diagram illustrating the detailed steps associated with 
calculating the LOD using cubic computations in operation 212 of Figure 2 in 
accordance with one embodiment of the present invention; 

Figure 4A illustrates a cube map where the geometrically arranged texture 
coordinates reside on separate sides of the cube map; and 

Figure 5 illustrates a flowchart delineating the steps of calculating a level of 
detail (LOD) in association with dependent texture and any other type of computer 
graphics processing. 
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Description of the Preferred Embodiments 

A cubic environment map is a texture map or general table indexed by a 
5 three-dimensional vector. If the indexing vector is a reflection vector, for example, 
specular spread functions can be incorporated into the maps themselves if they are 
based solely on the relative reflection angle, thus allowing highlighting, i.e. Phong 
highlighting. Since such highlights are pre-computed, there is no rendering-time 
penalty for a high number of light sources. Indeed, maps can contain area lights or 
10 photographic environments, or any combination of these. In general, though, the 
indexing vector can be anything the application requires. 

Figure 2 illustrates a flowchart delineating the steps of calculating a level of 
detail (LOD) during the cube environment mapping process. As is commonly 

1 5 known to those of ordinary skill in the art, such LOD is critical for determining the 
amount of a texture covered by a single pixel. As shown in Figure 2, parameter 
coordinates (s,t,r,q) are first identified in operation 200. It should be noted that 
parameter coordinates (s,t,r,q) are received for four pixels which are situated in a 
2x2 quadrilateral. In other words, there are four (s,t,r,q) quadruplets, or sixteen total 

20 values, identified in operation 200. 

Such parameter coordinates (s,t,r,q) represent coordinates in the parametric 
coordinate space, which is widely known to those of ordinary skill in the art. In 
particular, parameter coordinates (s,t,r,q) are used to represent texture-size- 
25 independent homogeneous three dimensional texture coordinates. 

It should be noted that the LOD computation of the present invention 
involves distances in pixels and thus requires working with texture coordinates (u, v, 
p). Texture coordinates (u, v, p) represent texture coordinates after scaling by the 
30 texture size and the homogeneous coordinate q. Specifically, u = (s / q) * width, etc. 



NVIDP0013/P000176 V4.0 



• # 



Figure 2 A is a diagram illustrating the geometrically arrangement of texture 
coordinates which, in the present description, may each be represented generally by 
the variable z. As shown, the coordinates may be representative of a quadrilateral, 
i.e. square, with z 0 being an upper left comer of the square, z, being an upper right 
5 comer of the square, z 2 being a lower left corner of the square, and z 3 being a lower 
right comer of the square. 

The process continues by determining in decision 202 whether the q-values 
of the parameter coordinates each have the same sign. If it is determined that the 

10 pixels of the 2x2 pixel quad have the same q sign in decision 202, the parameter 

coordinate values represent points that come from the same half space (i.e., either in 
front of the eye or in back of the eye), and the process may continue. If the signs 
differ, however, then the parameter coordinate values are based in different half 
spaces and thus cannot be used to compute a correct LOD. In such case, it is 

15 observed that the parameter coordinate values are "infinitely far apart" and thus the 
LOD value is marked to be set to "infinity." Note operation 203. It should be noted 
that the LOD hardware checks for this case and executes accordingly. 

Thereafter, in operation 206, a side of a cube map is selected. The selected 
20 side of the cube map is that which corresponds to the parameter coordinate with the 
highest absolute value. For example, if s were largest, and s > 0, then the positive x 
side of the cube map would be selected. If two or more parameter coordinates have 
the same absolute value, a convention may be established to pick one or the other. 

25 With continuing reference to Figure 2, the two smaller parameter coordinates 

are then divided by the parameter coordinate having the largest absolute value. See 
operation 208. As a result, four triplets (s\ t\ side) are generated. By definition, s 1 
and t f are in the range [-1 .0, 1 .0]. 

30 It is then determined in decision 209 whether the LOD value is marked to be 

set to infinity. If so, the LOD value is set to infinity in operation 213. If not, it is 
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determined in decision 210 whether all four "side" values of the triplets are the 
same. If not, the LOD is calculated using a cubical LOD computation in operation 
212. More information on such computation will be set forth in greater detail during 
reference to Figure 4. 

If, however, it is determined in decision 210 that all four side values of the 
triplets are the same, texture coordinates (u\ V) are calculated using Equations #2 in 
operation 214. Since the range of s' and t' are in [-1 .0, 1 .0], and it is desired that u' 
and v' span the cube map side, then size is set equal to half the width or height of the 
largest LOD of the texture map comprising the selected cube map side. Thereafter, 
the LOD is calculated using a planar LOD computation, as indicated in operation 
216. More information on such computation will be set forth in greater detail during 
reference to Figure 3. 

Equations #2 

u' = s f * size 
v* = f * size. 

20 

Figure 3 is a flow diagram illustrating the detailed steps associated with 
calculating the LOD using planar computations in operation 216 of Figure 2. As 
shown, in operation 300, an x derivative is calculated for each coordinate, i.e. i^, v x , 
p x , etc. by differentiating the bilinear function which is shown in Equations #3. 

25 

Equations #3 

z(x,y) = z 0 * (1-x) * (1-y) + z x * x * (1-y) + z 2 * (1-x) * y + z 3 * x * y, where 

30 x=0, y=0 at pixel 0 

x=l, y=0 at pixel 1 
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x=0, y=l at pixel 2 
x=l, y=l at pixel 3. 

The x derivative is calculated for each coordinate, i.e. u,,, v x , p x , etc using 
Equations #4. 

Equations #4 

u , x = ((u 1 .u 0 ) + (u 3 .u 2 ))/2 
V x = ((v l .v 0 ) + (v3.v 2 )y2 

P'x = ((Pl.Po) + (P3-P2))/2 

In operation 302, a y derivative is calculated for each coordinate, i.e. Uy, v y , 
py, etc. by differentiating the bilinear function described above. See Equations #5. 

Equations #5 

u , y = ((u 2 .u 0 ) + (u 3 .u 1 ))/2 
v' y =((v 2 .v 0 ) + (v 3 .v 1 ))/2 

P'y=((P2-Po) + (P3-Pl)y2 

Next, in operation 304, two distance values, and dy, are computed, as set 
forth in Equations #6. 

Equations #6 

d x = u x 2 + v x 2 + p x 2 
dy = Uy 2 + v y 2 + p y 2 
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Finally, in operation 306, the two distance values, and d y , are used to 
compute the LOD. This is accomplished using Equation #7. Such numerical 
solution provides a more efficient LOD calculation as opposed to alternative 
5 analytical methods. 



Figure 4 is a flow diagram illustrating the detailed steps associated with 
calculating the LOD value using cubic computations in operation 212 of Figure 2. 
First, in operation 400, the values (s\ t', side) from operation 208 of Figure 2 are 
converted to a different coordinate system (l,m,n) using a coordinate transform. 
1 5 An exemplary coordinate transform is shown in Table 1 . 

Figure 4A illustrates the criticality of performing the transform of operation 
400. As shown, a cube map has geometrically arranged texture coordinates that 
reside on separate sides of the cube map. Due to the negative texture coordinate 
20 values of one side of the cube map with respect to the other, erroneous results would 
occur from their use during the LOD calculation. 



Equation #7 



LOD = 7 2 log 2 (max (d,, dy)) 



10 



Table 1 



25 



void coord_transf orm ( float s, float t, int side, float *1, 



float *m, float *n) 



assert (width==height ) ; 



30 



float size = width/2.0; 



float u = s * 



size; 



float v = t * size;- 
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switch (side) 
{ 

case CUBE_NEGX: 

*l=-size; *m= v; *n= u; 
5 break; 

case CUBE_POSX: 

*1= size; *m= v; *n=-u; 

break; 
case CUBE_NEGY: 
10 *1= u; *m=-size; *n= v; 

break; 
case CUBE_POSY: 

*1= u; *m= size; *n=-v; 

break; 

15 case CUBE_NEGZ: 

* l=-u ; *m= v; *n=-size; 
break; 
case CUBE_POSZ: 

*1= u; *m= v; *n= size; 
20 break; 

} 

} 

Note that for this coordinate transformation to be successful, the two 
25 dimensional texture maps representing each side of the cubic environment map are 
restricted so that each side is square, and all maps are the same size. Thus a single 
"side" value can be used to represent all six texture maps. 

Next, in operation 402, four distance measures, c^, d^, d 13 , d 23 , are each 
30 calculated. Such is accomplished using Equations #8. 

Equations #8 

doi = 0i - lo) 2 + (mi - mo) 2 + (n, - i^) 2 
35 d 02 = (1 2 - 1 0 ) 2 + (m 2 - m^) 2 + (n 2 - 1^) 2 
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d 23 = (1 3 - 1 2 ) 2 



+ (m 3 - m 2 ) 2 + (n 3 - n 2 ) 2 



Finally, the four distance measures, do l5 d 02 , d 13 , d 23 , are used to compute the 
LOD. This is done using Equations #9. It should be noted that such numerical 
solution provides a more efficient LOD calculation as opposed to alternative 
analytical methods. 



In the present description, the LOD value is calculated in the context of cube 
environment mapping. It should be noted, however, that the LOD value may also be 
calculated in the foregoing manner during general texture mapping, during the use of 
dependent textures, programmable pixel shaders where texture coordinates are 
generated, or for any other purpose. 

A dependent texture is a texture map or general table indexed, at least once, 
by a function of a value looked up on a texture map or general table. Specifically, 
where a non-dependent texture look-up can be represented by Equation #10, 



Equations #9 



LOD = l / 2 log 2 (max (d^, d^, d 13 , d 23 )) 



Equation #10 



Pixel_value = texture_map(u, v, p) 



a dependent texture look-up can be represented by Equation #11. 



Equation #11 



Pixel_value = texture_map(function(texture_map(u, v, p))) 
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It should be noted that the number of texture map look-ups inclusive in a 
dependent texture is not limited to the two above, but can be iterated to as many 
stages as needed. 

5 Figure 5 illustrates a flowchart delineating the steps of calculating a level of 

detail (LOD) in association with dependent textures and any other type of computer 
graphics processing. As shown in Figure 5, parameter coordinates (s,t,r,q) of a 2x2 
pixel quadrilateral are first received in operation 500. Such operation is similar to 
that of operation 200 of Figure 2. 

10 

In decision 502, it is determined whether the q-values of the parameter 
coordinates each have the same sign. If it is determined that the pixels of the 2x2 
pixel quad have the same q sign in decision 502, it is observed that the parameter 
coordinate values are "infinitely far apart" and thus the LOD value is marked to be 
1 5 set to "infinity." Note operation 504. 



Thereafter, in operation 506, texture coordinates (u,v,p) are calculated by 
scaling the texture width, height and depth, respectively. It should be noted that 
these values are not limited to three dimensions. If associated hardware supports n 
20 dimensional lookups, then there would be n texture coordinates used during the use 
of the present invention. In the present description, three dimensions are assumed to 
clarify the presentation. 

It is then determined in decision 507 whether the LOD value is marked to be 
25 set to infinity. If so, the LOD value is set to infinity in operation 508. If not, the 

LOD is calculated using a planar LOD computation, as indicated in operation 509. It 
should be noted that such computations are those previously set forth in Figure 3. 

While various embodiments have been described above, it should be 
30 understood that they have been presented by way of example only, and not 

limitation. Thus, the breadth and scope of a preferred embodiment should not be 
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limited by any of the above-described exemplary embodiments, but should be 
defined only in accordance with the following claims and their equivalents. 
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